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Abstract: Many behavioural (Arkin, 1998) and deliberative (Russell and Norvig, 
1995) robot control methods have been developed. Besides investigating task 
execution by a single robot multi-agent systems are being developed. Unfortunately 
only some of those control methods have a formal description. To aggravate 
the situation, those control methods that have formal specifications use different 
formal means of description. This paper presents an outline of a unified formal 
description of systems composed of many embodied agents using behavioural 
or deliberative control methods. Such a description is needed to specify in an 
implementation independent way the functionality of programming frameworks 
(Markiewicz and Lucena, 2001). Transition function based approach to the formal 
description of the above mentioned systems has been assumed to facilitate the 
future implementation of thus specified programming frameworks. The presented 
description is a generalization of the formal description used for the specification 
of MRROC++ (Zieliński, 1999; Zieliński, 2001) Copyright ©2003 IFAC 
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1. INTRODUCTION 


This paper uses the definition of an agent as for- 
mulated in (Russell and Norvig. 1995); An agent 
is anything that can be viewed as perceiving its 
environment through sensors and acting upon that 
environment through effectors. The paper concen- 
trates on agents acting in physical environments, 
and not on abstract agents, e.g. acting in the 
World Wide Web. Agents operating in a physical 
environment gather information about its state 
through receptors (i.e. hardware sensors) and in- 
fluence its state through their effectors (e.g., actu- 
ators or motors combined with mechanical limbs, 
manipulator arm, leg or legs, wheels). Such arti- 
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facts are called embodied or robotic agents. 
The paper concentrates on the design of the soft- 
ware component of systems composed of such 
agents, and especially the formal tools for design- 
ing this software, i.e. programming frameworks. 


In general, programming frameworks are ap- 
plication generators for a specific domain of prob- 
lems (Markiewicz and Lucena, 2001). This paper 
concentrates on robot programming frameworks, 
i.e. libraries of software modules (procedures, ob- 
jects or processes) supplemented by design pat- 
terns for robot system controllers. A design pat- 
tern is composed of the so called frozen spots 
and hot spots. Frozen spots are the unalterable 
parts of the generated software and hot spots 
are the variable parts. Code of hot spots is de- 
livered by the system builder or extracted from 


the library of ready modules. Although the terms: 
framework and hot or frozen spots are fairly recent, 
the concept of providing a library of ready or 
modifiable modules that can be assembled ac- 
cording to a certain pattern into a ready to use 
application (e.g. controller), is quite old. Formerly 
frameworks used to be called simply robot pro- 
gramming or control libraries or languages, but 
both of those terms are not adequate. A library 
does not imply an associated software pattern 
into which the modules should be inserted, and 
a language is usually associated with a specific 
grammar (e.g. syntactic structure). As general 
purpose languages, such as Pascal or C have 
been used as the development tools for those li- 
braries, so no new language was being defined. 
Although initially specialised programming lan- 
guages had been favored, they lost they appeal, 
when it turned out that in the robotics domain 
the variability of equipment causes an ever greater 
demand for extensibility of those languages. Any 
extensions force a modification of the compiler 
or the interpreter of the language rendering the 
alteration more costly. Moreover, soon it became 
obvious that the specialised robot programming 
languages have to provide nearly all the capabili- 
ties of a general purpose programming language. 
Under those circumstances it was more reasonable 
to use a general purpose programming language 
and a library of modules specific to robot con- 
trol and to define a general pattern according to 
which they should be assembled. Thus, although 
specialised robot programming languages gained 
considerable popularity (e.g. WAVE (Paul, 1977), 
AL (Mujtaba and Goldman, 1979; Zieliński, 1992), 
VAL II (User's Guide to VAL II: Programming 
Manual Ver.2.0, 1986), AML (Taylor et al., 1982), 
RAPT (Ambler and Corner, 1984; Zieliński, 1992), 
SRL (Blume and Jakob, 1984; Blume and Jakob, 
1986), TORBOL (Zieliński, 1991; Zieliński, 1992)) 
robot programming frameworks have been espe- 
cially favored by the research community (e.g. 
RCCL (Hayward and Paul, 1986), Multi-RCCL 
(Lloyd and Hayward, 1993), KALI (Hayward and 
Hayati, 1988; Hayward et al., 1989; Backes et 
al., 1989), PASRO (Blume and Jakob, 1985; Blume 
and Jakob, 1986), RORC (Zielinski, 19956; Zieliński, 
1993), MRROC (Zieliński, 19956; Zieliński, 1995a), 
MRROC++ (Zieliński, 1997; Zieliński, 1999), GoM 
(Fleury and Herrb, 2001; Alami et al, 1998), 
DCA (Petersson et al, 2001), TCA (Simmons et 
al., 1997), TDL (Simmons and Apfelbaum, 1998), 
Generis (Morales, 1999), SmartSoft (Schlegel 
and Worz, 1999)). This paper presents a tool for 
formal specification of programming frameworks 
for systems composed of heterogeneous embodied 
agents. This description takes into account that: 


e It has to facilitate both the specification of 
the software of the designed system and its 
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implementation. Nevertheless, the means of 
the implementation (i.e. programming lan- 
guage, operating system etc.) should not be 
predetermined a prion. 

It should be flexible enough to encompass 
diverse structures of both the system and its 
components. 

The specification of behavioural agents, de- 
liberative agents or heterogeneous agents 
should be possible. 

The number and type of both the effectors 
and the sensors used should not be fixed. 


Summarizing, the paper proposes a formal method 
of describing multi-agent systems lending itself 
to structuring and implementation of a general 
programming framework for producing such sys- 
tems. The presented formalism is a generaliza- 
tion of the approach used to define and imple- 
ment the MRROC++ (Zieliński et al., 1998; Zielinski, 
1999; Zieliński, 2001; Zieliński et al., 2001) robot 
programming framework. MRROC++ based systems 
have either a hierarchical structure or a structure 
composed of independent entities In both cases no 
direct interaction between the agents is possible. 
Obviously indirect interactions through sensing 
or upper layers of hierarchy are possible. The 
presented formalism includes direct interactions 
between agents. 


2. EMBODIED AGENTS 


For the purpose of brevity, and because of contex- 
tual obviousness, the denotations assigned to the 
components of the considered system and their 
state will not be distinguished. 


Let us consider a multi-agent system consisting of 
Na agents. The state of a single embodied agent 


üj; J =1,..+,Na, is: 
sj =< cj èj: Vj > (1) 
where: 
cej — state of the control subsystem of the 
agent (i.e. memory: variables, program 
etc.), 
ej — state of the effector of the agent, 
V; — bundle of virtual sensor readings 


utilised by the agent. 


A bundle of virtual sensor readings contains ny, 
individual virtual sensor readings: 


Vy =< yee Ding, > (2) 
Each virtual sensor vj,, k = 1,...,ny,, produces 
an aggregate reading from one or more exterocep- 
tors. Exteroceptors, for brevity further on called 
simply receptors or real sensors, include all the 
measuring devices gathering information from the 


environment of the system. Interoceptors and pro- 
prioceptors, i.e. devices for measuring the inter- 
nal state of the system (e.g. position encoders, 
resolvers), are not treated here as receptors., be- 
cause they supply data about the state of the 
effectors and not the environment of the agent, 
and thus are associated with the effector. The 
data obtained from the receptors usually cannot 
be used directly in agent motion control, e.g. 
to control the arm motion, one would need the 
grasping location of the object that is to be picked 
and not the whole bit-map delivered by a camera. 
In some other cases a simple sensor in its own 
tight would not suffice to control the motion (e.g. 
a single touch sensor), but several such sensors 
deliver meaningful data. The process of extracting 
meaningful information for the purpose of motion 
control is named data aggregation and is per- 
formed by virtual sensors. Thus the kth virtual 
sensor reading obtained by the agent aj is formed 
as: 

UR = fu 


(er Ba) 8) 


where R;, is a bundle of receptor readings used 
for the creation of the kth virtual sensor reading. 
> (4) 


Ry, =< Teyr Tieng 


where n, is the number of receptor readings rj, , 
1 =1-...,n, taken into account in the process of 
forming the reading of the kth virtual sensor of 
the agent aj. It should be noted that (3) implies 
that the reading of the virtual sensor depends also 
on cj- In this way the agent has the capability 
of configuring the sensor as well as delivering 
to the virtual sensor the relevant information 
about the current state of the agent (including its 
effector). This might be necessary in the case of 
computing the reading of a virtual sensor having 
its associated receptors mounted on the effector 
(e.g. artificial skin). 


The responsibility of the agent's control subsys- 
tem cy is to: gather information about the state 
of the environment through the associated virtual 
sensor bundle Vj, obtain the information from 
the other agents a, (j’ # j), monitor the state 
of its own effector e,, and to process all of this 
information to produce: a new state of the ef 
fector e}, influence the future functioning of the 
virtual sensors V,, and send out information to 
the other agents aj’. As a side effect the internal 
state of the control subsystem c; changes. To do 
this effectively several components of the control 
subsystem can be distinguished: 


Ce, — image of the effector (this is a per- 
ception of the effector by the control 
subsystem, e.g. motor shaft positions, 


joint angles, end-effector location), 
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cv, images of the virtual sensors (i.e. cur- 
rent virtual sensor reading and config- 
uration), 

inter-agent transmission (i.e. informa- 
tion mutually transmitted between the 
agents), 

all the other relevant variables. 


fe, 
Thus the the control subsystem is partitioned: 


Cj =< Ce, ,Ce,s€V, CT, > (5) 
From the point of view of the system designer 
the state of the control subsystem changes at a 
servo sampling rate or a low multiple of that. If 
i denotes the current instant, the next considered 
instant is denoted by i+1. The control subsystem 


uses c} =< ci, Ci, Cy, Cr, > to produce ft a< 
anat otf ot >, ie: 
1 
cet! = fee, (Cey1Ce,+CV,»Cr,) 
1 
a =f (6,160, Chy er, ) (6) 
a a. 
Fev, (Cyt Cesi Eb, €r, ) 
a 
H = fer, (Co, Ce CV, »¢r,) 
or more compactly: 
1 
oi! = falo) (7) 


The control subsystem obtains the input values 
Ct, Ch,» Cr, through transmission from the other 
components of the agent itself (e.g. effector, vir- 
tual sensors) or the other agents. It also must 
transmit the computed values ¢:t1, c)", ct! to 
the other elements of the agent or the other part- 
ners. If we do not want to make any assumptions 
about the order of those transmissions and do not 
assume that the input and output images are of 
the same type (this occurs very rarely) duplicates 
of those entities must be stored. Only the internal 
variables ce, should have a single representation. 
Hence the control subsystem state can be repre- 
sented as (fig. 1): 

et! > (8) 


Cj =< ejs Ch Cet ch, Create 


3. A MULTI-AGENT SYSTEM 


The needs of communication between the agents 
are defined by the arguments of the transition 
functions (6). If the computation of any of the 
output values requires some input data, this input 
data has to be delivered to the agent's control 
subsystem, and this defines a connection between 
the source of this data and the agent's control 
subsystem. 


The agents of the described system can act: purely 
independently, they can interact directly through 


inter-agent 


reaching / 
comman 


Fig. 1. A single embodied agent aj, j =1,...,mMa 


an exchange of transmitted data (cr,), they can 
also interact indirectly by sensing (through the 
receptors) the other agents or the results of their 
actions, or they can be coordinated by a hier- 
archically higher entity, i.e. a coordinator. The 
coordinator, for the sake of consistency, can be 
treated as an abstract agent, i.e an agent that 
does not posses an effector (a body). Nevertheless, 
there is no reason to assume that the abstract 
agent should not gather directly the information 
from the environment, thus it can have a virtual 
sensor bundle of its own. In this case it would 
deliver global information about the environment, 
e.g. a camera gathering the information about the 
global state of the football pitch in a RoboCup 
match. Let us distinguish the coordinator by the 
subscript 0. In the face of the above its state will 
be: 


So =< co. Vo > (9) 
Hence the system state is described by: 
S =< $0, 81,006) Sn > (10) 


The structure of the coordinator will not be dis- 
cussed further in this paper. Let it suffice to say 
that it can be subdivided into other abstract sub- 
agents. 


4. INTERNAL FUNCTIONING OF AN 
AGENT 


Internal functioning of an agent is defined by the 
transition functions (6) or (7). The flexibility of a 
programming framework is located in the ability 
of expressing diverse approaches to programming 
the actions of each agent, and so the formal de- 
scription should enable easy formulation of diverse 
control strategies. Usually instead of computing a 
single set of functions (6) many partial functions 
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are evaluated and the final result is obtained by 
a certain composition of the partial results. Thus 
ny partial functions are defined: 


= "fe, (C}). 


ot} m=1,....ng (11) 
Moreover, the partial functions do not have to 
take as arguments all of the components of c}. 
The following subsections investigate some of the 


interesting possibilities. 


4.1 Purely reactive systems 


In the case of a purely reactive system the choice 
of the function "f,, is based on testing predicates 
Pe, q = 1,...,Mp which take as arguments only 
the components of cj, . In pseudo-code it can be 
expressed as: 


if pe; (ch) then cit? := "fe, (cf) endif (12) 


If in each step i only one out of the n, predicates 
De, is true, then a single function f,, is selected. 
Usually in such a case np = ny and therefore the 
control program contains np instructions of the 
type (12) executed in an endless loop. 


The system that is described in (Zielinski, 1994; 
Zieliński, 19956) performs the selection of the 
function ™fe, for several consecutive steps, i.e. the 
selection is less frequent than the evaluation of the 
function, so the reaction is composed of several 
steps. In that case a behaviour is defined as a 
sequence of states: 


b = {e+ a+2 atm} 


E (13) 
where ns is the number of steps in a behaviour 
(reaction). As this behaviour originates in c? it is 
labelled with the superscript i, in other words it 
depends on c}. The pseudo-code (12) represents a 
single-step behaviour, i.e. n, = 1. In the case of 
a multi-step behaviour the pseudo-code assumes 
the following form: 
if "pc, (cy,) then b5(c}) endif (14) 
In the case (14) the decision as to which be 
haviour should be executed is taken once every 
n, steps. Nevertheless, the transition between the 
state c}t“ and c}t**?, where e = 0,..., ns -1 
is still “computed on the basis of the functions 
™f.,. The control program is composed of a loop 
containing a sequence of instructions of the form 
(14). If none of the predicates 9p., (cy,) is true 
a default behaviour, called the main reaction or 
a goal pursuing reaction, is executed. The other 
reactions deal with some abnormal situations - 
hindering attaining of the goal. 


Rodney Brooks in (Brooks, 1986; Brooks, 1991) 
uses inhibition and suppression (exchange) mech- 
anism for the evaluation of the final value of cit? 
- in this case the state of augmented finite state 
automatons. Each of the automatons generates 
signals that are the result of a process equivalent 
to the computation of functions ™f.,. The sup- 
pression and inhibition mechanism is equivalent to 
a selection based not only on the values of input 
signals but also on the priorities of automatons, 
ie. priorities of the partial functions. In this way 
higher level behaviours can subsume the the lower 
level ones. 


Sometimes several predicates %pe, can be true 
simultaneously. In that case the values of several 
partial functions "f., have to be composed to- 
gether. Many composition operators can be con- 
ceived. Competitive methods are based on some 
form of selecting one value out of the computed 
values, e.g.: 

cit! = max "fo, (c3) (15) 
Cooperative methods are based on some form of 
superposition of the computed values, e.g.: 


my 
gA > PFa (E) (16) 


Weighted sums are the generalization of (16) and 
can be utilised also. 


All sensor readings are intrinsically inaccurate due 
to signal noise, resolution etc. Moreover frequently 
a binary decision is impossible. An interesting 
possibility is the utilisation of fuzzy reasoning 
(Driankov et al., 1993; Jantzen, 1999). Let the 
current sensor readings cy, contain ¢y, ~ some of 
the readings that are of interest to us. Moreover, 
let cy, belong to a sensor reading subspace Cy, 
~ a part of the sensor reading space Cy,. Each 
dimension of the space Cy, forms a universe uly, v 
u = 1,.-.,Mu, where ny is the number of those 
dimensions (universes). Each universe „Cy, can 
be further subdivided into N, regions "Cy,, h = 
1....,Ny. Each of those regions forms a support 
for a fuzzy set Fh. To create a fuzzy set Fit 
an adequate membership function ut must be 
provided. The functions uË map ,Cy, onto [0,1]. 
For the sake of brevity the fuzzy sets and the 
values of linguistic variables representing them are 
not distinguished here. 


Moreover, let either ct! or cit? contain the so 


called output value of Beside that let that value 
belong to a space O;. Here a one dimensional 
space is assumed. The space Oj will form an 
output universe. It must be divided into regions 
Of. g = 1,..-,No, which will form the supports 
for the output fuzzy sets °F, where no is the 
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number of those regions and thus the number of 
the output fuzzy sets. Again, to create the fuzzy 
sets °F9 adequate membership functions %49 must 
be provided. They map O; onto [0, 1]. 


Now the rule base can be constructed out of 
conditions formed by using the AND connective 
between the n, fuzzy predicates (again linguistic 
variables are not used): 


if (14, is Ff") AND (2¢4, is Fy?) 


AND...AND (n,éy, is Fu") (17) 
then (o%+? is °F?) 
where: ki = 1,..-,Nij 62 = lyo oea Na; oi ha, = 


1,...,.Nn,- The rule base consists of N, rules of 
the form (17). The fuzzification process converts 
each crisp value ,éy, into a degree of membership 
in Fy. As a result we obtain: 


att = ult (udi,) (18) 
where € = 1,...,ny. Aggregation consists in 
computation of the firing strength of the condition 
of each rule. In the case of the AND connective 
used in (17) the firing strength of the rule ¢ will 
be, e.g.: 

Ses min{as‘}, C=1,...,N, (19) 
where in each case the adequate «ę for the rule 
Ç are used. The firing strengths Sa are used to 
scale the output membership functions %49. Those 
scaled membership functions form the conclusions 
(fuzzy sets) $8. The resulting fuzzy set is obtained 
through accumulation, e.g. performing a max op- 
eration on a member by member basis on the fuzzy 
sets fØ, e.g. 


B= {max Slot) (20) 


The defuzzified crisp value of oùt? is finally ob- 


tained by e.g. finding the abscissa of the centre 
of gravity of the set 8. The thus computed value 
o'*? is inserted into either ci+! or ctt}, Multi-level 
fuzzy integration of behaviours is also possible, 
e.g. (Seraji and Howard, 2002). 


4.2 Generalized hybrid deliberative-reactive systems 


The purely reactive approach can be generalized 
if the predicates 9p., take as arguments not only 
Chy» but also other components of c}, especially 
ct, A purely deliberative system results if for the 
generation of c;*" functions having as arguments 
only c,, are used. This is rarely feasible in the 
case of embodied agents, as the state of the envi- 
ronment cannot be fully predicted, hence sensor 


readings cy, are necessary. In this way a hybrid 
deliberative-reactive systems result. Deliberation 
assumes the use of artificial intelligence techniques 
(Luger and Stubblefield, 1989) to find a plan (i.e. 
sequence) of actions leading the execution of a 
task (goal) set forth before the agent. In the case 
of deliberative or hybrid systems ce, must contain 
the representation of the state of the problem 
solution (not to be mistaken with the state of 
the environment or the agent itself). Moreover, 
within the agent there must exist operators, i.e. 
transition functions transforming one problem so- 
lution state into another, Those operators may 
result either from production rules or be the side- 
effect of application of predicate logic (Luger and 
Stubblefield, 1989). Deliberation is a search pro- 
cess starting in the initial state of the problem 
solution. This state includes a partial description 
of the current state of the agent, but also other 
search related information. As the operators are 
applied new problem solution states are gener- 
ated. Heuristics help in discarding the produced 
states that either do not lead to a solution or 
are along a far from optimal search path, thus 
avoiding a combinatorial explosion in the search 
process. The path leading from the initial state 
and ending in a goal state describes a plan of 
actions that the agent should try to execute. As- 
suming that the plan generation starts with ci, 
the plan (result of the search process) would be 
included in cit! and would influence the genera- 
tion of the state of the agent in the next steps, i.e. 
gt. .... In the case of hybrid systems this 
plan can be treated as a goal pursuing reaction 
(main reaction). If the planning process takes a 
lot of time, the plan might not be ready in the 
instant i + 1. In that case the function (7) would 
have to generate c}* without the plan, so that 
cit? would have to result in halting the effector - 
to be on the safe side. 

In the case of hybrid systems two approaches to 
plan generation can be followed. In the first case, 
the plan can be treated as a template and fixed 
corrective reactions handle minor problems with 
its execution. The plan constitutes a goal pursuing 
reaction and always the same corrective reactions 
are executed regardless of the step (action) in the 
plan. In the second case, the plan is generated 
with a changing set of corrective reaction for each 
action (plan step). This is equivalent to a system 
that changes both the goal pursuing reaction and 
the set of corrective reactions in each plan step 
Nevertheless, in both cases such problems can 
arise that further execution of the plan will be 
impossible. In that case replanning has to be done 
- obviously with the current state of the agent 
included in the initial problem solution state: 


ALO 


Besides using c}, as an argument of functions 
generating the value of c}*?, also cy, can be used. 
This implies direct cooperation of agents. Thus 
obtained information can be used both in the 
planning process as well as a parameter of the 
reactions, 


5, IMPLEMENTATION ISSUES 


The presented mathematical generic specification 
of multi-agent systems is based on transition func- 
tions and selection predicates. Both of those con- 
cepts are the basis of high-level general purpose 
computer programming languages. Mathematical 
functions can easily be transformed into a pro- 
gramming language (e.g. C, C++, Pascal) func- 
tions, procedures or OOP methods, while selec- 
tion predicates are well grounded in control flow 
instructions of programming languages (e-g. in C: 
if then else, switch etc.). Thus the transformation 
of the specification into software is straight for- 
ward. Specific cases of such transformations have 
been presented in (Zielifiski, 1994; Zieliński, 2001). 


Usually the control subsystem of an agent is not 
implemented as a single entity (e.g. process). In 
that case there is no direct link between e; and 
Ce, Both the input and the output effector images 
are being transformed through several intermedi- 
ate layers. For example, in MRROC++ the Effector 
Control Process (ECP), which is equivalent to 
the agent’s control subsystem, sends motion com- 
mands formed in the output effector image and 
receives the updates of the input effector image 
through Effector Driver Process (EDP) and Servo 
Group Process (SG) (Zieliński, 1999; Zieliński et 


al., 2001). This only introduces multi-stage trans- 
3+1 


missions: cyt! — et" and ej — ct, ies 
a+ i+1 atl _, pitt 
ae a, e; 
i j i i (21) 
os ty che ae, 


Sometimes the creation of a virtual sensor reading 
require a multi-stage process, e.g. Arkin (Arkin, 
1998) defines perceptual schemas that have that 
property. This also can be dealt with by a multi- 
stage aggregation and transmission similar to the 
one presented by (21). 


An agent might need to change its immediate 
goal upon changes in the environment or the 
state of the other agents. One of the reasons for 
this change might be the replanning process men- 
tioned earlier. To encode this type of behaviour 
it is convenient to use FSA (Finite State Au- 
tomatons/Acceptors) (Arkin, 1998). In this case 
within ce, a transition graph (usually represented 
as a transition table) would have to be encoded. 
With each node of the graph a behaviour or a 


set of concurrently executed behaviours would be 
associated. Upon termination of those behaviours 
(caused either by attaining the goal or permanent 
inability of reaching that state) the selection of 
the next graph node is made based on the current 
state of sensors c\, , state of the other agents Ch, 
and the agent’s own current state cj. This is 
performed by a transition function, so this idea 
is well grounded in the presented formalism. 


An important aspect of an agent’s activity is 
learning. For that purpose its control subsystem 
or a hierarchically higher entity must contain a 
critique. Its responsibility is to decide the result 
of the agent's actions. If the result is satisfactory 
either nothing is done or further tuning might be 
performed in hope of further improvement. If the 
result is unsatisfactory tuning must be done. Two 
kinds of tuning can be done. Either parameters 
of reactions are tuned (reinforced or weakened) 
or the whole code of reactions is changed. The 
second version is possible only if the code of the 
reactions is interpreted and not in binary form. 
In the first case the parameters of the functions 
(6) are modified and in the second case whole 
functions are altered. 


6. CONCLUSIONS 


Transition function based formalism facilitates the 
design and implementation of multi agent systems 
by decomposing a large system into components 
that can be designed and implemented by pro- 
viding the code for the specified functions. Each 
of the control subsystem components (8) can be 
treated as an object in an object-oriented pro- 
gramming sense. Thus the communication with 
the other agents, effectors or virtual sensors can be 
handled internally by the methods of these objects 
(MRROC++ uses this method). The objects provide 
through their public interfaces only the data that 
is necessary for the computation of the control 
of the agent. Those objects provide data that is 
utilised by transition functions (6) resident in the 
control subsystem to compute the next state of 
this subsystem. 


The formalism by enumerating the arguments of 
the transition functions (6) ensures that all the 
necessary interconnections between the compo- 
nents of the system will be present. The presented 
examples showed the numerous possibilities of de- 
signing such systems, e.g. purely reactive agents 
with diverse methods of composition of the fi- 
nal control signals, deliberative systems and hy- 
brid deliberative-reactive systems. Nevertheless, 
the presented formalism also poses many open 
research problems, especially regarding detailed 
methods of controlling an agent. For instance: 
for a given task the selection of behaviours b) 


H1 


of an agent aj is not obvious. Even less obvi- 
ous is the assignment of subtasks to agents in 
a multi-robot behavioural system. The definition 
of functions ™f,, defining a behaviour and the 
selection of predicates p., triggering a behaviour 
is also a difficult job. The treatment of abnormal 
situations (hardware or software errors) in both 
behavioural and deliberative systems also requires 
research. However, it should be noted that the 
enumerated problems pertain to the implementa- 
tion of a specific activity of an agent and not to 
the structure of the system, hence the presented 
formalism serves its purpose of providing a for- 
mal representation for describing the structure of 
multi-agent programming frameworks. It points 
out what has to be contained in the framework 
both in terms of building blocks and in terms 
of its structure, ie. what are the legal ways of 
assembling those building blocks. The formalism 
can also be used for describing the functioning of a 
single agent, but the control algorithm is external 
to the introduced notation. In other words, first 
we must have an idea of the control algorithm 
and only later we can express it in the presented 
formalism. The formalism only is a specification 
tool that facilitates the later implementation of 
the control system. 
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